Systems and methods for equalizing retransmission delays for data retransmission over bonded modems

ABSTRACT

Embodiments of the present invention provide systems for incorporating bonding processors while avoiding bonding processor buffer overflow by initiating retransmission requests on all data lines whenever corrupted data is encountered on one data line. Initiating these “extra” retransmission requests equalizes retransmissions delays over all transmission lines, preventing the bonding processor from receiving excess data that cannot be reassembled until the retransmission request is processed.

This application is a continuation is U.S. patent application Ser. No.13/251,079, filed Sep. 30, 2011, assigned U.S. Pat. No. 8,971,391, theentire contents of which are incorporated by reference.

FIELD OF THE INVENTION

This invention relates to data communications and more specifically todata rate matching.

BACKGROUND OF THE INVENTION

Bonding processors can be used to combine the functionality of twomodems (e.g., DSL modems) into a system that appears as one modem to anend user.

Previous bonding processor implementations resulted in bonding processorbuffer overflows when retransmission requests were initiated.

What is needed are methods and systems for preventing bonding processorbuffers from overflowing without causing a significant reduction in datarate.

BRIEF DESCRIPTION OF THE DRAWINGS/FIGURES

The accompanying drawings, which are incorporated in and constitute partof the specification, illustrate embodiments of the invention and,together with the general description given above and the detaileddescriptions of embodiments given below, serve to explain the principlesof the present invention. In the drawings:

FIG. 1A is a block diagram of a system for equalizing retransmission inaccordance with an embodiment of the present invention.

FIG. 1B is a block diagram illustrating packet fragmentation andreassembly in accordance with an embodiment of the present invention.

FIG. 1C is a block diagram illustrating data transmission unit (DTU)fragmentation and reassembly in accordance with an embodiment of thepresent invention.

FIG. 1D is a diagram illustrating retransmission of corrupted DTU's inaccordance with an embodiment of the present invention.

FIG. 2 is a flowchart of a method for equalizing retransmission at datareception equipment in accordance with an embodiment of the presentinvention.

FIG. 3 is a flowchart of a method for equalizing retransmission at datatransmission equipment in accordance with an embodiment of the presentinvention.

FIG. 4 is a flowchart of another method for equalizing retransmission atdata reception equipment in accordance with an embodiment of the presentinvention.

Features and advantages of the present invention will become moreapparent from the detailed description set forth below when taken inconjunction with the drawings, in which like reference charactersidentify corresponding elements throughout. In the drawings, likereference numbers generally indicate identical, functionally similar,and/or structurally similar elements. The drawing in which an elementfirst appears is indicated by the leftmost digit(s) in the correspondingreference number.

DETAILED DESCRIPTION OF THE INVENTION

In the following description, numerous specific details are set forth toprovide a thorough understanding of the invention. However, it will beapparent to those skilled in the art that the invention, includingstructures, systems, and methods, may be practiced without thesespecific details. The description and representation herein are thecommon means used by those experienced or skilled in the art to mosteffectively convey the substance of their work to others skilled in theart. In other instances, well-known methods, procedures, components, andcircuitry have not been described in detail to avoid unnecessarilyobscuring aspects of the invention.

References in the specification to “one embodiment,” “an embodiment,”“an example embodiment,” etc., indicate that the embodiment describedmay include a particular feature, structure, or characteristic, butevery embodiment may not necessarily include the particular feature,structure, or characteristic. Moreover, such phrases are not necessarilyreferring to the same embodiment. Further, when a particular feature,structure, or characteristic is described in connection with anembodiment, it is submitted that it is within the knowledge of oneskilled in the art to affect such feature, structure, or characteristicin connection with other embodiments whether or not explicitlydescribed.

1. OVERVIEW

Bonding processors can be used to combine the functionality of twomodems (e.g., DSL modems) into a system that appears as one modem to anend user. For example, a bonding processor can be used to take a streamof packets sent from a network and break it into two (or more) streamsof packet fragments for transmission over two modems. These streams canbe reassembled into the original stream by another bonding processorbefore the information is transmitted to an end user. Splitting up asingle data stream into multiple, simultaneously transmitted datastreams can improve performance (e.g., by increasing data transmissionspeed).

If an error occurs while the packet fragments are being transmitted,this error is detected by a reception modem, and the reception modem caninitiate a retransmission request (e.g., according to the ITUrecommendation G.998.4 “Ginp”) to the transmission modem to sendreplacement data for the data that was corrupted during transmission.Retransmission requests can introduce additional delay because areception modem may not be able to properly process incoming packetsuntil the retransmission of corrupted data has been processed. Manysteps taken to compensate for this retransmission delay introduceunattractive complications (e.g., requiring large memory buffers orlowering the data rate).

The use of multiple data streams can introduce additional complicationsfor bonding processors when errors occur during data transmission. Forexample, a bonding processor may need to reassemble a packet fromfragments that are transmitted over multiple data streams. Atransmission error due to corrupted data in any one of these streams cancause the bonding processor to delay reassembling data from all streamswhile the corrupted data is retransmitted. However, while the dataretransmission is being processed, data continues to flow to the bondingprocessor over all streams, which can cause buffers in the bondingprocessor to overflow.

Embodiments of the present invention provide solutions to this bondingprocessor buffer overflow problem by initiating retransmission requestson additional (e.g., all) data lines whenever corrupted data isencountered on one line. Initiating these “extra” retransmissionrequests equalizes retransmissions delays over all transmission lines,preventing the bonding processor from receiving excess data that cannotbe reassembled until the retransmission request is processed. Thus,embodiments of the present invention advantageously provide systems andmethods for utilizing bonding processors to increase data transmissionperformance while avoiding potential bonding processor buffer overflowscaused by errors in data transmission (e.g., due to noise in atransmission medium) over one stream.

Because the transmission lines are bonded together via bondingprocessors, it is reasonable to expect that data transmitted over thesetransmission lines will encounter similar and simultaneous impulse noiseover many or all of the transmission lines. As a result, initiating“extra” retransmission requests has a minimal impact on performance(e.g., data rate) because it is reasonable to expect that datacorruption encountered in one line of a plurality of bonded transmissionlines also occurred in one or more of the other bonded lines due to thesame error-inducing event. Thus, embodiments of the present inventionadvantageously provide solutions to the bonding processor bufferoverflow problem discussed above while minimally impacting performance.

2. SYSTEMS 2.1 System Elements

A system for equalizing retransmission delays in accordance with anembodiment of the present invention will now be described with referenceto FIG. 1A. FIG. 1A is a block diagram representing data transmissionequipment 100 (e.g., equipment at a service provider) and data receptionequipment 102 (e.g., equipment installed at the home of a customer). InFIG. 1A, data is sent from a network 104 to a transmission (TX) bondingprocessor 106. TX bonding processor 106 splits this data into one ormore streams to increase data transmission performance (e.g.,transmission speed).

Each of these data streams is transmitted simultaneously over parallellines to data reception equipment 102. In an embodiment of the inventionillustrated by FIG. 1A, each of these data streams is transmitted by adifferent modem (e.g., TX modem 108 and TX modem 110). In an embodiment,TX modem 108 and TX modem 110 are Digital Subscriber Line (DSL) modems.While two transmission modems are illustrated in FIG. 1A, it should beunderstood that data can be split into any number of streams fortransmission to data reception equipment 102 using any number oftransmission modems. For example, in an embodiment of the presentinvention, data sent from network 104 is divided into fragments sentover four separate streams, and each of these four streams issimultaneously transmitted to data reception equipment 102 using fourseparate transmission modems.

Data transmission equipment 100 simultaneously transmits the datastreams to data reception equipment 102 over a medium 112. Medium 112can be any medium for transmitting data (e.g., the Internet, WiFi, acable, etc.). Data reception equipment 102 receives these simultaneouslytransmitted steams using, for example, a plurality or reception (RX)modems (e.g., DSL modems). While FIG. 1A show two reception modems (RXmodem 114 and RX modem 116), it should be understood that any number ofRX modems can be used to receive data. For example, in a system usingfour streams for data transmission, four RX modems can be used toreceive the data. In an embodiment, RX modems 114 through 116 arecoupled to TX modems 108 through 110 over a bidirectional communicationlink.

Data received by RX modems 114 through 116 is reassembled into the datastream that was transmitted from network 104 using RX bonding processor118. RX bonding processor 118 can then transmit the reassembled data tocustomer equipment 120 (e.g., a customer's home computer). Morespecifically, TX bonding processor 106 divides a data stream intofragments, and RX bonding processor 118 reassembles this data streamfrom the transmitted fragments, before passing them on to customerequipment 120.

It should be understood that the elements of FIG. 1A described above canbe implemented on the same integrated circuit (IC) or on separate ICs.For example, in an embodiment. TX bonding processor 106 and TX modems108 through 110 can be implemented on the same IC. Likewise in anembodiment, RX modems 114 through 116 and RX bonding processor 118 canbe implemented on the same IC. Further, in an embodiment. TX modems 108through 110 are implemented on the same IC (but on a separate IC fromthe IC implementing TX bonding processor 106), and RX modems 114 through116 are implemented on the same IC (but on a separate IC from the ICimplementing RX bonding processor 118).

2.2 Packet Fragmentation and Reassembly

Packet fragmentation and reassembly in accordance with an embodiment ofthe invention will now be described with reference to FIG. 1B. FIG. 1Bis a block diagram illustrating how TX bonding processor 106 breaks data122 received from network 104 into fragments 125 to be output to TXmodems 108 through 110. FIG. 1B further illustrates how RX bondingprocessor 118 receives data fragments 134 from RX modems 114 through 116and reassembles these fragments 134 into the original packets 136 sentby network 104 before these packets 136 are transmitted to customerequipment 120.

FIG. 1B shows three exemplary packets 124, 130, and 132 received by TXbonding processor 106 from network 104. TX bonding processor 106 breakseach of these packets into separate fragments for simultaneoustransmission over TX modems 108 through 100. For example, TX bondingprocessor 106 breaks packet P1 124 into fragments F1 ₁ 126 through F1_(N) 128.

In an embodiment, TX bonding processor 106 includes information in eachfragment indicating an order of reassembly to be utilized by RX bondingprocessor 118 when reassembling the fragments into packets. For example,fragment F1 ₁ 126 can include information indicating that it should beplaced before fragment F1 _(N) 128 when RX bonding processor 118reassembles these fragments into packet P1 124. This information can beincluded, for example, in a header or footer appended to each fragment.

The transmitted fragments are received and reassembled by RX bondingprocessor 118. For example, RX bonding processor 118 reassemblesfragments F1 ₁ 126 through F1 _(N) 128 into packet P1 124. As previouslydiscussed, RX bonding processor 118 reassembles fragments in order basedon information appended to the fragments. Because different fragments ofthe same packet can be transmitted over separate streams, an error(e.g., corrupted data) that occurs on any one of the transmissionstreams can prevent RX bonding processor 118 from reassembling thepacket until the data containing the error is retransmitted.

For example, in FIG. 1B, packet P1 124 is reassembled by RX bondingprocessor 118 from fragments F1 ₁ 126 through F1 _(N) 128. In anembodiment, RX bonding processor 118 has to reassemble fragments F1 ₁126 through F1 _(N) 128 in a proper order. For example, RX bondingprocessor 118 has to properly receive fragment F1 ₁ 126 before it canprocess F1 _(N) 128 because fragment F1 _(N) 128 contains informationindicating that it should be placed behind fragment F1 ₁ 126 when RXbonding processor 118 reassembles packet P1 124.

According to an embodiment of the present invention, a series offragments is further divided into smaller units (e.g., into a series ofdata transmission units, or “DTUs”) by transmission modems before theyare received by reception modems. For example, in an embodiment, aseries of fragments is divided into DTUs of differing sizes. Each DTUcan contain several fragments, a piece of a fragment, or portions ofmultiple fragments. For example, one DTU may contain a piece of a firstfragment, an entire second fragment, and a piece of a third fragment.

In an embodiment, each of these DTUs is appended with informationindicating an order of reassembly (e.g., a sequence identification, or“SID”), and a reception modem uses this information to properlyreassemble the DTUs into fragments. Thus, an error occurring in any DTUof a fragment can delay reassembly of the entire fragment. DTU errordetection and retransmission is described in greater detail below.

If a DTU was corrupted during transmission, the reception modeminitiates a retransmission request over the transmission line that sentthis DTU. For example, if RX modem 114 received a corrupted DTU, then RXmodem 114 requests a retransmission of the corrupted DTU from TX modem108. This retransmission lakes additional time to process because of thetime required for the retransmission request to reach TX modem 108 andthe time required for TX modem 108 to send the replacement DTU back toRX modem 114.

While the retransmission request is being processed, RX modems 114-116can continue to receive data. Because at least some of this data cannotbe properly reassembled until the retransmission of the corrupted datareaches RX modem 114, RX modem 114 stores this data for later processing(e.g., in buffers). Thus, data can begin to collect in the buffers of RXmodem 114. After the corrupted data has been retransmitted to RX modem114, RX modem 114 can begin to reassemble the data with the rest of thedata that has collected in its buffers while the retransmission wasbeing processed. RX modem 114 can then transmit this reassembled data toRX bonding processor 118.

However, while a retransmission is being processed for one modem (e.g.,for RX modem 114) other RX modem(s) (e.g., RX modem 116) can continue toreassemble data (e.g., DTUs) into fragments and forward these fragmentsto bonding processor 118 for reassembly into packets. For example, RXmodem 116 may forward fragment F1 _(N) 128 to bonding processor 118.However, as previously discussed, RX bonding processor 118 reassemblesfragments into packets in a particular order of assembly. For example,RX bonding processor 118 reassembles fragments into packets according tothe original order of transmission of these fragments by TX bondingprocessor 106. If RX bonding processor 118 is waiting for a transmissionof a DTU from RX modem 114 that contains information from fragment thatwas transmitted earlier (e.g., fragment F1 ₁ 126), RX bonding processor118 cannot properly reassemble fragments that were transmitted later(e.g., fragment F1 _(N) 128) until the retransmission is processed andRX modem 114 sends the DTU that contains the information from theearlier fragment (e.g., fragment F1 ₁ 126). Thus, retransmission delaysin RX modems 114 through 116 can cause fragments to collect in thebuffers of bonding processor 118, which can eventually lead to a bufferoverflow in bonding processor 118. The potential for buffer overflow inbonding processor 118 can be especially high if a large number of RXmodems 114 through 116 are bonded together via RX bonding processor 118.

One potential solution to this problem is to delay sending data from RXmodem 114 (and/or additional RX modem(s)) to RX bonding processor 118until the data rate reaches a speed that RX bonding processor 118 canproperly process, given its memory requirements. However, lowering thedata rate in a system incorporating bonding processors is especiallydisadvantageous because bonding processors are frequently used toattempt to increase data rate. Further, RX modem 114 (and/or additionalRX modem(s)) may also have memory limitations. Embodiments of thepresent invention solve this buffer overflow problem by incorporating aretransmission equalization module (REM) 142 or 144 into one or moreportions of data reception equipment 102 and/or data transmissionequipment 100.

Another problem can arise when “old” data collects in the buffers of TXbonding processor 106. For example, in an embodiment, each DTU is alsoappended with a timestamp, which can be used to enforce configuredminDelay and maxDelay parameters (e.g., parameters for setting limitsfor transmission delays as described in the G.998.4 recommendation).According to the G.998.4 recommendation, it should be sufficient to setminDelay to be equal to maxDelay to avoid overflowing the buffers of RXbonding processor 118. The maxDelay parameter is typically configured tobe large (typically 20 mSec) to allow good retransmission performance.However, this claim in the G.998.4 recommendation is based on 2 falseassumptions: (1) that the RX modem 114 has enough memory to implement alarge minDelay at a high data rate and (2) that TX bonding processor 106has no fragment buffers. If TX bonding processor 106 has fragmentbuffers, the time stamps on the DTUs may not reflect when the data wasfragmented, and this can cause the Ginp receiver (e.g., RX modem 114) todelay output of a DTU that contains information from “old” fragments.

For example, if RX modem 114 encounters a maxDelay long error event(e.g., as described by the G.998.4 recommendation). RX modem 114requests retransmissions for maxDelay time. During this time, one ormore fragments collect in the buffers of TX bonding processor 106. Oncethe error event stops, RX modem 114 starts receiving “good” DTUs andbegins reassembling them. Initially, RX modem 114 receives “old” DTUsfrom fragments that TX bonding processor 106 has been trying to send formaxDelay time. Because these DTUs are “old” and have “old” timestamps,they are sent to RX bonding processor 118 immediately. Eventually, RXbonding processor 118 receives “new” DTUs, but these “new” DTUs cancontain information from “old” fragments. Because these DTUs are “new”and have “new” timestamps, the RX modem 114 delays output of the DTUsfor minDelay time. In the meantime, another RX modem (e.g., RX modem116) may have output data that requires information from fragments fromthe “new” DTUs that contain “old” data. This situation can also causethe buffers of RX bonding processor 118 to overflow.

Embodiments of the present invention provide solutions to this problemby incorporating a REM into potions of data transmission equipment 100.By initiating one or more additional retransmissions on one or moreadditional transmission lines whenever a retransmission request isreceived, embodiments of the present invention avoid the buffer overflowissues in RX bonding processor 118 described above because delays areequalized across all transmission lines.

2.3 Retransmission Equalization Module

In an embodiment, REM 142 is a hardware, software, or firmware modulethat initiates one or more retransmission requests to mimic the delaythat occurs on one transmission line (e.g., due to a retransmission ofdata) on one or more additional transmission lines, such that delays areequalized across all transmission lines. For example, if an error isdetected in a DTU received by RX modem 114, RX modem 114 sends aretransmission request to TX modem 108. In accordance with embodimentsof the present invention, REM 142 initiates one or more additionalretransmission requests to TX modem 110 even though no error wasdetected by RX modem 116. In an embodiment, REM 142 initiates enoughadditional retransmission requests such that the delay caused by theprocessing of the retransmission from TX modem 110 is equivalent to thedelay caused by processing the additional retransmissions (e.g., from TXmodem 110) initiated by the additional retransmission requests. Theseadditional retransmission requests equalize delays due to retransmissionprocessing time on all data lines so that additional fragments do notcontinue to be forwarded to bonding processor 118 after a retransmissionhas been initiated on one data line. By equalizing delays on alltransmission lines whenever a retransmission request is sent across onetransmission line, REM 142 reduces the potential for buffer overflow inRX bonding processor 118, because fewer fragments are allowed collect inthe buffers of RX bonding processor 118 while a retransmission is beingprocessed on any data line.

For example, REM 142 can detect that a transmission error occurred in aDTU. Because RX modem 114 will issue a retransmission request to TXmodem 108 for another copy of the corrupted DTU, REM 142 initiates oneor more matching retransmission request to TX modem 110 so that both RXmodem 114 and RX modem 116 “wait” an approximately equivalent amount oftime to receive retransmitted data before forwarding fragments tobonding processor 118 while the retransmission from TX modem 110 isbeing processed. Thus, by sending this matching retransmission request.REM 142 equalizes retransmission time on all data lines.

In an embodiment, REM 142 can be configured to initiate allretransmission requests (and not simply initiate matching retransmissionrequests after an RX modem has initiated a retransmission request). Forexample, if an error is detected by RX modem 114, REM 142 cart beconfigured to initiate retransmission requests to all of TX modems 108through 110. Thus, in this embodiment, none of RX modems 114 through 116send retransmission requests.

Additionally, while REM 142 is shown in FIG. 1A as being coupled to RXmodems 114 through 116, it should be understood that one or more REM(s)142 can also be implemented on the same IC as any, some, or all of RXmodems 114 through 116 in accordance with embodiments of the presentinvention. Further, in an embodiment, REM 142 is implemented on the sameIC as bonding processor 118. In another embodiment, REM 142 isimplemented on a separate IC from any of the elements of data receptionequipment 102.

A retransmission equalization module can also be implemented on datatransmission equipment 100 (e.g., shown in FIG. 1A as REM 144). Forexample, in an embodiment, REM 144 is a hardware, software, or firmwaremodule coupled to one or more of TX modems 108 through 110. When REM 144detects a retransmission request sent to one modem (e.g., sent to TXmodem 108) from data reception equipment 102, REM 144 initiates amatching retransmission of data so that retransmission delays areequalized across all data lines. For example, if REM 144 detects aretransmission request sent to TX modem 108. TX modem 108 sends aretransmission of data, and REM 144 initiates a matching retransmissionof data from TX modem 110. In an embodiment, REM 144 initiates both theretransmission of data from TX modem 108 and the retransmission of datafrom TX modem 110.

Further, while FIG. 1A shows REM 144 as being implemented on a separateIC from the rest of the elements of data transmission equipment 100, itshould be understood that REM 144 can also be implemented on the same ICas any, some, or all of TX modems 108 through 110 in accordance withembodiments of the present invention. It should also be understood thatREM 144 can be implemented on the same IC as TX bonding processor 106.

2.4 Retransmission of Data Transmission Units

Data transmission unit (DTU) fragmentation and reassembly in accordancewith an embodiment of the present invention will now be explained withreference to FIG. 1C. As previously discussed, each transmission modemcan break fragments into smaller portions (e.g., into packet transfermode (PTM) codewords, cells, and/or DTUs) before transmitting them to acorresponding reception modem. For example, FIG. 1C shows fragments 142input to TX modem 108 from TX bonding processor 106. In an embodiment,TX modem 108 breaks these fragments into DTUs. For example, TX modembreaks fragment F1 ₁ 126 into DTUs D1 through D4 146 before outputting144 these DTUs 146 to RX modem 114. RX modem 114 receives 148 DTUs D1through D4 146. If no errors are detected, RX modem 114 reassembles DTUsD1 through D4 146 into fragment F1 ₁ 126 and outputs 150 fragment F1 ₁126 to RX bonding processor 118. As TX modem 108 continues to transmitDTUs to RX modem 114, RX modem 114 continues to reassemble these DTUsinto fragments and outputs 150 the fragments to RX bonding processor118. As previously discussed, the order of reassembly of the DTUs isbased on data appended to each DTU indicating its reassembly priority(e.g., the SID). While FIG. 1C shows fragment F1 ₁ 126 being broken intoDTUs D1 through D4, it should be understood that any number of fragmentscan be broken up into any number of DTUs in accordance with embodimentsof the present invention and that each DTU can contain severalfragments, a piece of a fragment, or portions of multiple fragments.

DTU error detection and retransmission will now be explained withreference to FIG. 1D. FIG. 1D illustrates different events that occurwhen an error is detected in a received DTU. In step 152, an RX modem(e.g., RX modem 114) detects an error in DTU D1 154 and sends aretransmission request for D1 154 to the corresponding transmissionmodem (e.g., TX modem 108). In step 156. RX modem 114 awaitsretransmission of DTU D1 154. While the retransmission is beingprocessed, additional DTUs (e.g., DTUs D2 through D6 158) begin tocollect in the buffers of RX modem 114. RX modem 114 cannot properlyreassemble DTUs D2 through D6 158 because DTU D1 154 has a higherpriority. Thus, DTUs D2 through D6 158 are stored until DTU D1 154 isretransmitted. In step 160, RX modem 114 receives the retransmission 162of DTU D1 154 and can then properly continue reassembling DTU's intofragments.

As previously discussed, while a retransmission is being processed foran RX modem (e.g., RX modem 114), other RX modems (e.g., RX modem 116)continue to transmit fragments assembled from other received DTUs to RXbonding processor 118. If RX bonding processor 118 needs a fragment fromRX modem 114 (e.g., fragment F1 ₁ 126) before it can reassemble thefragment(s) sent from RX modem 116, buffer overflow is possible, becauseadditional fragments can continue to collect in the buffers of RXbonding processor 118 while it is waiting for fragment F1 ₁ 1126.

According to embodiments of the present invention a REM (e.g., REM 142or 144) initiates one or more additional retransmissions of DTUs toother TX modems (e.g., to TX modem 110) so that delays are equalizedacross all transmission lines. In an embodiment, the additionalretransmissions of DTUs are retransmissions for “dummy” DTUs containingno data. By equalizing delays across all transmission lines, unwantedbuffer overflow in RX bonding processor 118 is avoided.

2.5 Delay Equalization without Initiating Additional RetransmissionRequests

In an embodiment of the present invention, each modem (e.g., TX modems108 through 110 and RX modems 114 through 116) have a Packet TransferMode (“PTM”) encapsulation module. PTM is a mode designed to provide alow-overhead mechanism for transmitting packets over DSL links. When TXbonding processor 106 sends fragments to a transmission modem, TXbonding processer 106 sends these fragments to the PTM encapsulationmodule in the transmission modem. When a transmission modem receives aretransmission request, the PTM encapsulation module of thistransmission modem temporarily stops taking fragments from TX bondingprocessor 106 while the retransmission request is processed. Forexample, if TX modem 108 receives a request to retransmit DTU D1 154,the PTM encapsulation module of TX modem 108 temporarily stops takingfragments from TX bonding processor 106. While data (e.g., fragments)has temporarily stopped flowing to TX modem 108, data continues to nowto other transmission modems (e.g., TX modem 110). This continued flowof data on one or more transmission lines while data has stopped flowingacross one transmission line can cause delay discrepancies among thetransmission lines and can eventually lead to an overflow in the buffersof RX bonding processor 118.

Embodiments of the present invention provide additional solutions toequalize retransmission delays across all data lines to prevent thesedelay discrepancies without altering the processing of retransmissionrequests. In an embodiment, when a transmission modem (e.g., TX modem108) receives a request to retransmit data (e.g., a request toretransmit DTU D1 154) and the PTM encapsulation module of TX modem 108stops taking fragments from TX bonding processor 106, TX bondingprocessor 106 is instructed (e.g., by a hardware, software, or firmwaremodule coupled to TX bonding processor 106) to temporarily halttransmission of fragments to one or more additional transmission modems(e.g., to TX modem 110) while the retransmission is being processed.Alternatively, in an embodiment, this module can instruct the one ormore additional transmission modems (e.g., TX modem 110) to stopreceiving fragments from TX bonding processor 106 while theretransmission is being processed. After TX modem 108 processes theretransmission, the PTM encapsulation module of TX modem 108 can resumereceiving fragments. TX bonding processor 106 detects the ability of thePTM encapsulation module of TX modem 108 to receive fragments andresumes transmitting fragments to TX modem 108. The hardware, software,or firmware module coupled to TX bonding processor 106 detects thisresumption of fragment transmission to TX modem 108 and instructs TXbonding processor 106 to resume sending fragments to the one or moreadditional TX modems (e.g., to TX modem 110) as well. By temporarilyhalting transmission of fragments over one or more additional data lineswhenever a retransmission is being processed for one line, embodimentsof the present invention advantageously avoid the buffer overflowproblem due to continued transmission of “old” data in DTUs describedabove.

In an embodiment, when a reception modem (e.g., RX modem 114) initiatesa retransmission of data (e.g., a request to retransmit DTU D1 154), oneor more additional reception modems (e.g., RX modem 116) are temporarilyinstructed (e.g., via by a hardware, software, or firmware modulecoupled to one or more reception modems) to instruct the correspondingtransmission modem to stop receiving fragments from TX bonding processor106 while the retransmission is being processed. In an embodiment, if RXmodem 114 sends a retransmission request, RX modem 116 is instructed tosend an All Idle Out-of-synch (“AIOOS”) to TX modem 110 to temporarilyinstruct the PTM encapsulation module of TX modem 110 to stop takingfragments from TX bonding processor 106 while the retransmission isprocessed. After RX modem 114 receives the retransmission. RX modem 116is instructed to stop transmitting the AIOOS so TX modem 110 cancontinue to receive fragments from TX bonding processor 106.

Thus, some embodiments of the present invention enable equalization ofdelays across multiple transmission lines without requiring anyadditional retransmission requests. In an embodiment, the hardware,software, or firmware module that instructs TX bonding processor 106 totemporarily halt transmission of fragments while a retransmission isbeing processed is implemented on the same IC as REM 144, and thehardware, software, or firmware module that instructs one or moreadditional reception modems to temporarily send an AIOOS while aretransmission is being processed is implemented on the same IC as REM142. However, it should be understood that the delay equalizationmodules described in this section may, but do not necessarily,incorporate functionality for requesting one or more additionalretransmissions of data.

2.6 Additional Embodiments

REM 142 (and/or REM 144) may also be further configured to account foradditional considerations when sending additional retransmissionrequests in accordance with some embodiments of the present invention.For example, depending on the hardware of any two modems, delays betweenthese two modems may vary (e.g., one modem may process packets fasterthan the other modem), and these delays can negatively impactperformance. In an embodiment, REM 142 is configured to detect thesedelay variations and compensate for them by requesting a retransmissionof a fewer or greater number of DTUs so that the effective data ratesover each transmission line are effectively matched.

For example, DTUs transmitted over one transmission line may not be thesame size (e.g., bit length) as DTUs transmitted across one or moreother transmission lines. DTUs transmitted by TX modem 108 and DTUstransmitted by TX modem 110 may be different sizes (e.g., due tohardware differences between TX modem 108 and TX modem 110). Further,the bit rate of TX modem 108 may differ from the bit rate of TX modem110. Embodiments of the present invention provide additional mechanismsfor compensating for these additional factors (e.g., DTU size and bitrate differences among modems) when initiating additional retransmissionrequests. For example, in an embodiment, REM 142 (or REM 144) attemptsto match DTU size and/or bit rate when initiating additionalretransmissions.

Some embodiments of the present invention match the percentage of bitrate degradation caused by retransmission over different transmissionlines. Thus, if line X (e.g., the line between TX modem 108 and RX modem114) must retransmit k % of its total bandwidth to correct errors, lineY (e.g., the line between TX modem 110 and RX modem 116) should alsorequest retransmission of k % of its total bandwidth. When both line Xand line Y have errors to correct, the line with the higher percentageof errors dictates the value of k.

Some embodiments of the present invention provide a shared accumulatorto implement bit rate matching. Each time line X requests aretransmission, the accumulator is incremented byL_(DTU)(lineX)/L(lineX), and each time line Y requests a retransmissionthe accumulator is decremented by L_(DTU)(lineY)/L(lineY), where L_(DTU)represents the bit length of the DTU being retransmitted, and L is thenumber of bits per discrete multi-tone (DMT) symbol. If the accumulatoris larger than a line Y threshold, line Y will start requesting extraretransmissions. If the accumulator is smaller than a line X threshold,line X will start requesting extra retransmissions. In an embodiment,“extra” retransmissions are counted the same as normal retransmissionsrelative to updating the accumulator. In an embodiment, the smalleststable line Y threshold is MAX(L_(DTU)(lineX)/L(lineX),L_(DTU)(lineY)/L(lineY))*0.5, and the largest stable line X threshold isthe negative of the smallest stable line Y threshold. There is somelatitude to “tune” the thresholds, since the true constraint is (line Ythreshold−line X threshold)>=MAX(L_(DTU)(lineX)/L(lineX),Ldtu(lineY)/L(lineY)). In an embodiment, each line keeps an accumulator,and the difference between the accumulators are examined to determine ifany extra retransmissions need to be requested.

In an embodiment, the output of data from one line is delayed if it hasgotten too far ahead of the other line (e.g., determined based on theSID that is applied to each DTU). This applies a “back pressure” on theGinp receive state machine, first causing it to use the receiveretransmission storage to try to match the delay of the lines, and whenthat is not sufficient, it forces extra retransmission requests (e.g.,because as new data arrives but there is no place to store it, aretransmission request is sent). This “back pressure” mechanism has along delay associated with it, and that can result in oscillatingretransmission requests between the lines. In an embodiment, theoscillation is damped out by disallowing line X from delaying output fora period of time after line Y has been forced to delay output.

In another embodiment. RX bonding processor 118 is instructed (e.g., byREM 142 or REM 144) to stop taking data when its buffer has reachedcapacity. This is fed back to the Ginp receive state machine as“backpressure” that can cause the same reaction as described above.

3. METHODS

A method for equalizing retransmission in accordance with an embodimentof the present invention will now be described with reference to FIG. 2.FIG. 1A and FIG. 1D. In step 200, a first set of data transmissions isreceived over a first transmission line, and a second set of datatransmissions is received over a second transmission line. For example,RX modem 114 receives a first set of DTUs from TX modem 108, and RXmodem 116 receives a second set of DTUs from TX modem 110.

In step 202, a transmission error is detected in a first datatransmission in the first set of data transmissions. For example, atransmission error is detected (e.g., by RX modem 114, and/or REM 142)in a DTU (e.g., in DTU D1 154). In step 204, a retransmission isrequested for a second data transmission in the second set of datatransmissions responsive to detecting the transmission error. Forexample, REM 142 initiates a retransmission of a DTU from TX modem 110.In an embodiment, this retransmission from REM 142 is initiatedsimultaneously with a retransmission initiated to replace corrupted DTUD1 154. By simultaneously initiating a retransmission from both TX modem108 and TX modem 110, retransmission delays are equalized across bothdata lines, which avoids potential buffer overflow in bonding processor118.

Another method for equalizing retransmission in accordance with anembodiment of the present invention will now be described with referenceto FIG. 3. FIG. 1A and FIG. 1D. In step 300, a first set of datatransmissions is transmitted over a first transmission line, and asecond set of data transmissions is transmitted over a secondtransmission line. For example, a first set of DTUs is transmitted by TXmodem 108, and a second set of DTUs is transmitted by TX modem 110. Instep 302, a retransmission request sent over the first transmission lineis detected. For example, a retransmission request sent to TX modem 108is detected (e.g., by TX modem 108 and/or REM 144) for DTU D1 154.

In step 304, a retransmission of a second data transmission in thesecond set of data transmissions is sent responsive to detecting theretransmission request. For example, REM 144 initiates a retransmissionof a DTU. In an embodiment, this retransmission from REM 144 isinitiated simultaneously with a retransmission initiated to replace theDTU D1 154. By simultaneously initiating a retransmission from both TXmodem 108 and TX modem 110, retransmission delays are equalized acrossboth data lines, which avoids potential buffer overflow in bondingprocessor 118.

Another method for equalizing retransmission in accordance with anembodiment of the present invention will now be described with referenceto FIG. 4, FIG. 1A and FIG. 1D. In step 400, a first set of datatransmissions is received over a first transmission line, and a secondset of data transmissions is received over a second transmission line.For example, RX modem 114 receives a first set of DTUs from TX modem108, and RX modem 116 receives a second set of DTUs from TX modem 110.

In step 402, a first bit rate of the first transmission line and asecond bit rate over the second transmission line are determined. Forexample, the bit rate of data sent from RX modem 114 is determined(e.g., by REM 142 and/or RX modem 114), and the bit rate of data sentfrom RX modem 116 is determined (e.g., by REM 142 and/or RX modem 116).In step 404, a transmission error is detected in a first datatransmission in the first set of data transmissions. For example, atransmission error is detected (e.g., by RX modem 114 and/or REM 142) ina DTU (e.g., DTU D1 154).

In step 406, a second data transmission in the second set of datatransmissions is selected based on the calculated first bit rate andsecond bit rate. For example, REM 142 may determine that the bit rate ofdata sent from RX modem 114 is faster than the bit rate of data sentfrom RX modem 116. When REM 142 selects one or more DTUs forretransmission, REM 142 selects DTUs so that the data rates across bothtransmission lines are effectively matched.

In step 408, a retransmission is requested for the second datatransmission responsive to detecting the transmission error. In anembodiment, this retransmission from REM 142 is initiated simultaneouslywith a retransmission initiated to replace corrupted DTU D1 154. Bysimultaneously initiating a retransmission from both TX modem 108 and TXmodem 110, and by selecting one or more DTUs for retransmission based onthe determined bit rates of the data lines, retransmission delays areequalized across all data lines, which avoids potential buffer overflowin bonding processor 118.

4. CONCLUSION

It is to be appreciated that the Detailed Description section, and notthe Abstract section, is intended to be used to interpret the claims.The Abstract section may set forth one or more but not all exemplaryembodiments of the present invention as contemplated by the inventor(s),and thus, is not intended to limit the present invention and theappended claims in any way.

The present invention has been described above with the aid offunctional building blocks illustrating the implementation of specifiedfunctions and relationships thereof. The boundaries of these functionalbuilding blocks have been arbitrarily defined herein for the convenienceof the description. Alternate boundaries can be defined so long as thespecified functions and relationships thereof are appropriatelyperformed.

The foregoing description of the specific embodiments will so fullyreveal the general nature of the invention that others can, by applyingknowledge within the skill of the art, readily modify and/or adapt forvarious applications such specific embodiments, without undueexperimentation, without departing from the general concept of thepresent invention. Therefore, such adaptations and modifications areintended to be within the meaning and range of equivalents of thedisclosed embodiments, based on the teaching and guidance presentedherein. It is to be understood that the phraseology or terminologyherein is for the purpose of description and not of limitation, suchthat the terminology or phraseology of the present specification is tobe interpreted by the skilled artisan in light of the teachings andguidance.

The representative signal processing functions described herein (e.g. TXbonding processor, RX bonding processor, retransmission equalizationmodule [REM], etc.) can be implemented in hardware, software, or somecombination thereof. For instance, the signal processing functions canbe implemented using computer processors, computer logic, applicationspecific circuits (ASIC), digital signal processors, etc., as will beunderstood by those skilled in the arts based on the discussion givenherein. Accordingly, any processor that performs the signal processingfunctions described herein is within the scope and spirit of the presentinvention.

Further, the signal processing functions described herein could beembodied by computer program instructions that are executed by acomputer processor or any one of the hardware devices listed above. Thecomputer program instructions cause the processor to perform the signalprocessing functions described herein. The computer program instructions(e.g. software) can be stored in a computer usable medium, computerprogram medium, or any storage medium that can be accessed by a computeror processor. Such media include a memory device such as a RAM or ROM,or other type of computer storage medium such as a computer disk or CDROM, or the equivalent. Accordingly, any computer storage medium havingcomputer program code that cause a processor to perform the signalprocessing functions described herein are within the scope and spirit ofthe present invention.

The above systems and methods may be implemented as a computer programexecuting on a machine, as a computer program product, or as a tangibleand/or non-transitory computer-readable medium having storedinstructions. For example, the functions described herein could beembodied by computer program instructions that are executed by acomputer processor or any one of the hardware devices listed above. Thecomputer program instructions cause the processor to perform the signalprocessing functions described herein. The computer program instructions(e.g. software) can be stored in a tangible non-transitory computerusable medium, computer program medium, or any storage medium that canbe accessed by a computer or processor. Such media include a memorydevice such as a RAM or ROM, or other type of computer storage mediumsuch as a computer disk or CD ROM. Accordingly, any tangiblenon-transitory computer storage medium having computer program code thatcause a processor to perform the signal processing functions describedherein are within the scope and spirit of the present invention.

While various embodiments of the present invention have been describedabove, it should be understood that they have been presented by way ofexample only, and not limitation. It will be apparent to persons skilledin the relevant art that various changes in form and detail can be madetherein without departing from the spirit and scope of the invention.Thus, the breadth and scope of the present invention should not belimited by any of the above-described exemplary embodiments, but shouldbe defined only in accordance with the following claims and theirequivalents.

What is claimed is:
 1. A system comprising: a bonding processor; a firsttransmission modem configured to receive first data from the bondingprocessor, wherein the first transmission modem is in communication witha first reception modem; a second transmission modem configured toreceive second data from the bonding processor, wherein the secondtransmission modem is in communication with a second reception modem,and a retransmission equalization module (REM) coupled to the bondingprocessor, wherein the REM is configured to: responsive to detecting arequest for a retransmission of data from the second reception modem,initiate: a first halt in transmission of the first data from thebonding processor to the first transmission modem while theretransmission is being processed, and a second halt in transmission ofthe second data from the bonding processor to the second transmissionmodem while the retransmission is being processed.
 2. The system ofclaim 1, wherein the second transmission modem comprises a packettransfer mode (PTM) encapsulation module.
 3. The system of claim 2,wherein the PTM encapsulation module is configured to halt receiving thesecond data from the bonding processor.
 4. The system of claim 1,wherein the REM is further configured to: responsive to detecting acompletion of the retransmission of data, initiate: a first resumptionof transmission of the first data from the bonding processor to thefirst transmission modem, and a second resumption of transmission of thesecond data from the bonding processor to the second transmission modem.5. The system of claim 1, wherein the first reception modem, secondreception modem, first transmission modem, and second transmission modemare DSL modems.
 6. A method, comprising: receiving, at a firsttransmission device, first data transmitted over a first transmissionline from a bonding device, wherein the first transmission device is incommunication over a second transmission line with a first receivingdevice; receiving, at a second transmission device, second datatransmitted over a third transmission line from the bonding device,wherein the second transmission device is in communication over a fourthtransmission line with a second receiving device; detecting a requestfor a retransmission of data from the second receiving device; andresponsive to detecting the request, initiating: a first halt intransmission of the first data from the bonding device to the firsttransmission device while the retransmission is being processed, and asecond halt in transmission of the second data from the bonding deviceto the second transmission device while the retransmission is beingprocessed.
 7. The method of claim 6, further comprising: responsive todetecting a completion of the retransmission of data, initiating: afirst resumption of transmission of the first data, and a secondresumption of transmission of the second data.
 8. A system comprising: afirst reception modem in communication with a first transmission modemcoupled to a bonding processor; a second reception modem incommunication with a second transmission modem coupled to the bondingprocessor; and a retransmission equalization module (REM) coupled to thefirst reception modem and the second reception modem, wherein the REM isconfigured to: responsive to detecting a request for a retransmission ofdata from the second reception modem, initiate: a first halt intransmission of first data from the bonding processor to the firsttransmission modem while the retransmission is being processed, and asecond halt in transmission of second data from the bonding processor tothe second transmission modem while the retransmission is beingprocessed.
 9. The system of claim 8, wherein the second transmissionmodem comprises a packet transfer mode (PTM) encapsulation module. 10.The system of claim 9, wherein the PTM encapsulation module isconfigured to halt receiving the second data from the bonding processor.11. The system of claim 8, wherein the REM is further configured to:responsive to detecting a completion of the retransmission of data,initiate: a first resumption of transmission of the first data from thebonding processor to the first transmission modern, and a secondresumption of transmission of the second data from the bonding processorto the second transmission modern.
 12. The system of claim 9, whereinthe second reception modem is configured to transmit a signal to thesecond transmission modem to temporarily instruct the secondtransmission modem to stop receiving data from the bonding processorwhile the request is being processed.
 13. The system of claim 12,wherein the second reception modem is configured to transmit the signalto a packet transfer mode (PTM) encapsulation module of the secondtransmission modem.
 14. The system of claim 12, wherein the signal is anAll Idle Out-of-synch (AIOOS) signal.
 15. The system of claim 12,further comprising: a second bonding processor coupled to the firstreception modem and the second reception modem.
 16. The system of claim12, further comprising: a second REM coupled to the first transmissionmodem and the second transmission modem.
 17. A method, comprising:receiving first data over a first transmission line from a firsttransmission modem and second data over a second transmission line froma second transmission modem; initiating a request for a retransmissionof the second data; and responsive to initiating the request,initiating: a first halt in transmission of first data from a bondingprocessor to the first transmission modem while the retransmission isbeing processed, and a second halt in transmission of second data fromthe bonding processor to the second transmission modem while theretransmission is being processed.
 18. The method of claim 17, furthercomprising: responsive to detecting a completion of the retransmissionof data, initiating: a first resumption of transmission of the firstdata, and a second resumption of transmission of the second data. 19.The method of claim 17, further comprising: transmitting a signal to thesecond transmission modem to temporarily instruct the secondtransmission modem to stop receiving the second data while the requestis being processed.
 20. The system of claim 1, further comprising: afirst physical transmission link coupling the bonding processor to thefirst transmission modem; and a second physical transmission linkcoupling the bonding processor to the second transmission modem, whereinthe REM is configured to: initiate the first halt in transmission of thefirst data over the first physical transmission link while theretransmission is being processed, and initiate the second halt intransmission of the second data over the second physical transmissionlink while the retransmission is being processed.